Pictorial navigation

ABSTRACT

Methods, systems and program products provide pictorial information relevant to a geographic location, through selecting characteristics relevant to geographic locations, searching pictorial image databases for images having an embedded tags associated with the characteristics, retrieving image files from databases having embedded tags correlated to characteristics and visually depicting a physical appearance or an attribute of a location, analyzing characteristics image files and responsively selecting preferred image data, formatting preferred image data for presentation to a user, associating formatted preferred data with geographic locations, and presenting associated formatted data to a user in association with geographic locations. Characteristic include global positioning satellite coordinates. Image data may be selected having preferred image resolutions or perspectives. Formatting pictorial information may comprise synthesizing photographs into a constructs. Associated image data may indicate a distance and direction from a geographic location. Routing system applications are enabled to present pictorial information with each navigation route points.

FIELD OF THE INVENTION

The present invention generally relates to utilizing image informationin navigation and, more particularly, to methods, systems, and programproducts for incorporating pictorial navigation aids into navigationdevices and systems. It is also amenable to other applications in whichit is desirable to convey information through graphic imagecommunications.

BACKGROUND OF THE INVENTION

A wide variety of navigational aids systems and devices are available tohelp with finding a desired destination. Static directional informationmay be generated through user inputs to computer system or processorapplications: examples include printed text directions or map imageswith route highlights provided by Mapquest® and Google Maps™applications. However, static directional navigation informationprepared and generated prior to embarkation may be difficult orinefficient to use as a traveler's position changes in real-time, andmay even be rendered useless due to unanticipated changes or detours inthe actual route taken. Some static route system disadvantages may beovercome by real-time navigation processes, for example OnStar® andGarmin™ devices which use Global Positioning Satellite (GPS)communications to continuously track current geographic position andresponsively update navigational directions through text, map images andeven narrative sound modules. Such real-time devices can thus provideadvantages over static systems with contextual information updates,including audio prompts (e.g. “turn right in 10 seconds”).

However, the abstract nature of the navigational information presentedby both conventional static and real-time systems presents problems inuser application to real-world travel scenarios. For example, processingand translating audio cues into meaningful information in the context ofunderstanding and reacting to the vistas presented to the movingtraveler is difficult, particularly for unfamiliar destinations. Andgenerally it is easier for a traveler, and in particular a vehicledriver, to visually scan ahead for recognized landmarks or otherexpected items rather than hear, process and interpret text, map graphicimagery or audio information. Moreover, some unfamiliar destinations maybe unrecognizable due to problems in understanding and processingtextual, map or audio information.

Some systems, such as for example those provided or supported by GoogleMaps™ address some of these problems by providing satellite or aerialphotograph imagery of the actual destinations, thus providing imagesless abstract and more relevant to the actual locations being navigatedby the user. However, the substantially over-head perspective of suchaerial or satellite imagery, along with the distant perspective of thedevice used to acquire the image, limits their ability to conveycomprehensive, detailed and meaningful visual information to a travelerseeing a destination from a much closer vantage point, and typicallyfrom a horizontal perspective. Thus satellite or aerial photographimagery provide yet another abstract representation of the actualdestination that must, as with textual and audio information, beprocessed and translated by the user in order to understand itsrelationship to the actual visual appearance of a given destination.

Moreover, prior art over-head imagery, text, maps and audio informationare inherently insufficient with respect to some desired information.For example, searching for an acceptable restaurant may requireadditional appearance information: does the restaurant look well-run andmaintained? Is it located in a pleasant area? Is there a play area forchildren, and if so is the play area adequate in terms of design? Arethe amenities outdoors and subject to the weather? (What is acceptableon a nice temperate day may be unacceptable in extreme weather.)

SUMMARY OF THE INVENTION

The present invention relates to methods, systems and program productsfor providing pictorial information relevant to a geographic location.Thus a method comprises selecting a characteristic relevant to ageographic location; searching a pictorial image database for imageshaving an embedded tag associated with the characteristic; in responseto searching, retrieving at least one image file from the databasehaving an embedded tag correlated to the geographic locationcharacteristic and visually depicting a physical appearance or anattribute of the location; analyzing characteristics of the at least oneimage file and responsively selecting preferred image data from the atleast one image file; formatting the preferred image data forpresentation to a user; associating the formatted preferred image datawith the geographic location; and presenting the associated formattedpreferred image data to a user in association with the geographiclocation.

In another aspect of a method a characteristic comprises globalpositioning satellite coordinates, the method comprising selecting thecharacteristic by determining global positioning satellite coordinatesof a geographic location, searching a database comprises comparingdetermined geographic global positioning satellite coordinates to globalpositioning satellite coordinate tags embedded in image files, andretrieving at least one image file comprises retrieving image fileshaving embedded global positioning satellite coordinates tags correlatedto the determined global positioning satellite coordinates.

In another aspect a method comprises analyzing characteristics andresponsively selecting preferred image data by selecting photographseach having a preferred image resolution or selecting image filespresenting a horizontal perspective representation of the location. Inone aspect a method comprises formatting preferred pictorial informationby synthesizing a plurality of photographs into a constructrepresentative of the geographic location. In another aspect a methodcomprises associating formatted preferred image data with the geographiclocation indicating a distance and direction of the formatted preferredimage data from the geographic location. And in one aspect geographiclocations are a plurality of navigation route points generated by arouting system application, and a method comprises enabling the routingsystem application to present the associated pictorial information to auser in association with each of the navigation route points.

In one method a computer infrastructure is provided, for example by aservice provider who offers to implement, deploy, and/or performfunctions for others, the computer infrastructure being operable toselect a characteristic relevant to a geographic location; search apictorial image database for images having an embedded tag associatedwith the characteristic; in response to the search, retrieve at leastone image file from the database having an embedded tag correlated tothe geographic location characteristic and visually depicting a physicalappearance or an attribute of the location; analyze characteristics ofthe at least one retrieved image file and responsively select preferredimage data from the at least one retrieved image file; format thepreferred image data for presentation to a user; associate the formattedpreferred image data with the geographic location; and present theassociated formatted preferred image data to a user in association withthe geographic location.

In another aspect a computer infrastructure is provided being operableto identify a characteristic by determining global positioning satellitecoordinates of a geographic location; search a database by comparing thedetermined global positioning satellite coordinates to digital imagelocation tags embedded in image files; and retrieve at least one imagefile by retrieving image files having embedded global positioningsatellite coordinates tags correlated to the determined globalpositioning satellite coordinates. In another aspect a computerinfrastructure is provided being operable to analyze characteristics andresponsively select preferred image data by selecting photographs eachhaving a preferred image resolution or selecting image files presentinga horizontal perspective representation of the location. In anotheraspect a computer infrastructure is provided being operable to formatpreferred pictorial information by synthesizing a plurality ofphotographs into a construct representative of the geographic location.In one aspect a computer infrastructure is provided being operable toassociate formatted preferred image data with geographic location byindicating a distance and direction of formatted preferred image datafrom the geographic location. And in one aspect geographic locations area plurality of navigation route points generated by a routing systemapplication, wherein a computer infrastructure is provided beingoperable to enable the routing system application to present theassociated pictorial information to the user in association with each ofthe navigation route points.

In another aspect a method comprises producing computer executableprogram code; storing the code on a computer readable medium; andproviding the program code to be deployed and executed on a computersystem. The program code comprises instructions which, when executed onthe computer system, cause the computer system to select acharacteristic relevant to a geographic location; search a pictorialimage database for images having an embedded tag associated with theselected characteristic; in response to the search, retrieve at leastone image file from the database having an embedded tag correlated tothe selected characteristic and visually depicting a physical appearanceor an attribute of the location; analyze characteristics of the at leastone image file and responsively select preferred image data from the atleast one image file; format the preferred image data for presentationto a user; associate the formatted preferred image data with thegeographic location; and present the associated formatted preferredimage data to a user in association with the geographic location.

In one aspect program code instructions, when executed on a computersystem, cause the computer system to identify relevant characteristic bydetermining global positioning satellite coordinates of a geographiclocation; search a database by comparing determined global positioningsatellite coordinates to digital image location tags embedded in imagefiles; and retrieve at least one image file by retrieving image fileshaving embedded global positioning satellite coordinates tags correlatedto the determined global positioning satellite coordinates. In anotheraspect program code instructions, when executed on a computer system,cause a computer system to analyze characteristics and responsivelyselect preferred image data by selecting photographs each having apreferred image resolution or selecting image files presenting ahorizontal perspective representation of the location. In still anotheraspect program code instructions, when executed on a computer system,cause the computer system to format preferred pictorial information bysynthesizing a plurality of photographs into a construct representativeof the geographic location. In one aspect program code instructions,when executed on a computer system, cause the computer system toassociate formatted preferred image data with geographic location byindicating a distance and direction of the formatted preferred imagedata from the geographic location. And in another aspect, wherein thegeographic location is a plurality of navigation route points generatedby a routing system application, program code instructions, whenexecuted on a computer system, cause the computer system to enable arouting system application to present the associated pictorialinformation to the user in association with each of the navigation routepoints.

In still another aspect a system is provided comprising an identifierconfigured to identify a characteristic of a geographic location; aretriever configured to search a pictorial image database for imageshaving an embedded tag associated with the identified characteristic andretrieve at least one image file from the database having an embeddedtag correlated to the identified characteristic and visually depicting aphysical appearance or an attribute of the location; an analyzerconfigured to analyze characteristics of the at least one image file andresponsively select preferred image data from the at least one imagefile; a formatter configured to format the preferred image data forpresentation to a user; and a presenter configured to associate theformatted preferred image data with the geographic location and presentthe associated formatted preferred image data to a user in associationwith the geographic location.

In one aspect a system identifier is configured to determine theidentified characteristic by determining global positioning satellitecoordinates of the geographic location, and a retriever is configured tocompare the determined global positioning satellite coordinates todigital image location tags embedded in image files and retrieve imagefiles having embedded global positioning satellite coordinates tagscorrelated to the determined global positioning satellite coordinates.In another aspect a system analyzer is configured to select photographseach having a preferred image resolution or image files presenting ahorizontal perspective representation of the location. In still anotheraspect a system formatter is configured to synthesize a plurality ofphotographs a construct representative of the geographic location.

In one aspect a system presenter is configured to indicate a distanceand direction of the formatted preferred image data from the geographiclocation. And in another aspect wherein geographic locations are aplurality of navigation route points generated by a routing systemapplication, a system presenter is configured to enable a routing systemapplication to present the associated pictorial information to a user inassociation with each of the navigation route points.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features of this invention will be more readilyunderstood from the following detailed description of the variousaspects of the invention taken in conjunction with the accompanyingdrawings in which:

FIG. 1 illustrates a system and process for providing pictorialinformation relevant to a geographic location.

FIG. 2 illustrates a system and process for providing pictorialinformation relevant to one or more location points.

FIG. 3 illustrates a system and process for providing pictorialinformation relevant to location characteristics.

FIG. 4 illustrates an exemplary computerized implementation of a systemand process for providing pictorial information relevant to a geographiclocation.

The drawings are not necessarily to scale. The drawings are merelyschematic representations, not intended to portray specific parametersof the invention. The drawings are intended to depict only typicalembodiments of the invention, and therefore should not be considered aslimiting the scope of the invention. In the drawings, like numberingrepresents like elements.

DETAILED DESCRIPTION OF THE INVENTION

For convenience purposes, the Detailed Description of the Invention hasthe following sections

I. General Description

II. Computerized Implementation

I. General Description

Referring now to FIG. 1, a high-level illustration of a method andsystem for acquiring and using pictorial information is illustrated. At101 a geographic location is identified. At 103 an image selectionprocess is performed with respect to the identified location, whereinpictorial information relevant to one or more characteristics of theidentified location is selected and retrieved. The retrieved pictorialinformation includes photographs and any other graphic imagesrepresentative of a physical appearance of the location that will help atraveler recognize the location upon an arrival thereat and/or evaluatean attribute of the location. Thus in some examples pictorialinformation advertising graphic images including business names andlogos used in exterior signage, and trade-dress architectural imagesrepresentative of actual building exteriors may be appropriatelyassociated with a business location. Photos or graphic images oflocation details or interiors may also be retrieved and provided, forexample including restaurant interiors, public or private amenities suchas pools and play grounds, and/or graphic representations thereof.

At 105 the retrieved pictorial information is analyzed and if necessarysubject to additional selection, refinement or processing in order toidentify a most relevant subset image or plurality of images forassociation and use with the identified location. Thus for example ifonly one photograph is retrieved at 103, that single photograph isassociated with the identified location; however, if a plurality ofimages are returned at 103, then the returned information is analyzedand a subset of one or more of the returned images is selected forassociation. And, generally dependent upon the characteristics of thesubset information or of the processes used for said subset selection,the information is formatted for presentation to a user in associationwith the identified location 107. And if not already done so at 107, theuser is presented with the formatted and associated information at 109.

FIG. 2 illustrates a method and system for acquiring and using pictorialinformation with respect to a navigation route or other plurality ofdiscrete location points. At 202 one or more physical location pointsare provided, for example navigation route origin, waypoint anddestination points generated by a static or real-time routing systemapplication or device. The type of navigational system is not critical,and one skilled in the art will appreciate that the present system andmethod may be adapted for use with many types of navigational systemsand devices. Moreover, it is to be understood the present system andmethod may be applied outside of navigational system applications, andthus for example to any pluralities of identified locations. At 204 afirst one of the location points is chosen, such as for example a routeorigin point or a current location determined by a real-time GPS device.At 206 image selection processes 101/103/105 are performed with respectto the chosen location, and thus pictorial information relevant to oneor more characteristics of the chosen location is selected and retrievedfor presentation to the user. At 208 and 210 the system and methodselects each of the remaining plurality of location points (for exampleroute turn, waypoint, and/or final destination points) and repeats thepictorial information selection and retrieval process for each locationpoint until no more locations exist. The process ends with compilationof selected retrieved information into a presentation to a user at 212,thus including formatting 107 and presentation 109 processes, which maybe performed for individual or pluralities of the location points.

In one aspect the retrieved pictorial information is selected to providephotographic navigation aids which allow travelers to visualize theroute they are taking, enabling travelers to see photos of where theyare going, such as landmarks along the way, and what the finaldestination looks like. This will help people become more familiar witha new route, better visualize where they need to make turns, and helpchoose a destination.

In particular, providing photographs near or at locations of turnspermits travelers to anticipate such upcoming turns. And improved turnanticipation, without the need to look for street signs or otherin-place navigational aids, results in travelers missing fewer desiredintersections, as well as effectively increasing turn preparation times,whether walking or driving.

Moreover, photograph or graphic image information may rapidly impart awealth of information to a traveler in a more time efficient mannercompared to text-based information techniques. Thus improvements areprovided over prior art navigation systems which require a traveler tosearch a text guidebook or enter search terms into a GPS device forinformation retrieval from database accessed by or stored on the device,which generally results in text information outputs, and which even thenmay return incomplete or inadequate information. For example, textinformation that a restaurant at a chosen location has a play area doesnot generally indicate whether the play area is inside andclimate-controlled or outside, and if outside whether sheltered from thesun, wind or rain or exposed to the elements, information that may beboth critical to a traveler traveling in extreme weather conditions andreadily and instantly ascertainable from one or more pictures or graphicimages.

Pictorial information may also efficiently and rapidly provideinformation about areas surrounding the chosen location. The traveler isthus provided with advance knowledge of a significant landmark near thelocation, such as water tower or distinct building, which may be spottedwell in advance of arrival at the location and thus aid navigationthereto. Pictorial information may also give an immediate impression ofqualities of locations and/or areas nearby, rapidly and efficientlyproviding information beyond text media communication capabilities, suchas for example allowing a traveler to form an opinion as to whether alocation looks well maintained, is safely lit, affords on-streetparking, has sufficiently large, accessible and/or child-friendlypedestrian pathways and amenities, or offers a pleasant and invitingoverall vista.

Accordingly, in one aspect one or more characteristics may be selectedand used to retrieve pictorial information, and/or select preferredimages or image subsets from the retrieved pictorial information, forexample to present selected pictorial information for presentment infurther of one or more of the objectives discussed above, as well asothers. FIG. 3 illustrates an example of a pictorial informationselection and retrieval process according to the present invention, inone aspect adaptable to the selection and retrieval processes andsystems illustrated in FIGS. 1 and 2 and discussed above. At 302 one ormore characteristics are determined as relevant to a chosen location andwhich may be used to search for and retrieve relevant pictorialinformation.

More particularly, in addition to image data, digital photos and otherimage files frequently incorporate discrete informational fields or“tags” which comprise discrete informational fields. Exemplary tagsinclude the following suggested for incorporation by the InternationalPress Telecommunications Council (IPTC): caption, a narrativedescription of the image subject and related subject data; keywords: alist of discrete words related to image subject matter; photographername and/or employing agency name; copyright information; date of imagecreation; city; province/state; country; special instructions, which maylist restrictions on image usage; byline field; category code, relatedto media characterization; headline subject data, a short form ofsubject matter narrative; and source, the provider of the image.Embedded tags may also include GPS tags: for example, GPS-Photo Linksoftware by GeoSpatial Experts, LLC enables a digital camera to importGPS coordinates from a GPS unit in communication with the camera andembed the coordinates into a digital photo file. Accordingly, in oneembodiment at 304 one or more image databases or search services aresearched for digital images having tags or other identifiers correlatedwith characteristics selected and identified at 204.

Examples of search services and searchable databases include GoogleImages™, Flickr.com™, Lexus/Nexus®, The Associated Press, and ReutersGroup PLC, though other services and databases may be utilized. Any ofthe tag information discussed thus far, as well as other tags oridentifying characteristics, may thus be used for searching for relevantdigital images. In one embodiment GPS coordinates associated with achosen location are ascertained at 302 and used to retrieve images withcorrelated GPS tags at 304. Other geographic indicia search examplesinclude street addresses, proximate cross-street identifications, UnitedStates census tract or postal zip code, governmental entity(municipality, county, and/or state, nation, continent, etc.);geographic features such as waterways, bodies of water, mountains,bridges, railroad tracks; identified locations such as parks, resorts,stadiums, airports. Non-geographic tag data may also be identified asrelevant to a location and used for general keyword and search termsearching tag searching, for example including facility or occupantnames or location use related subject matters, and still other usefulsearch criteria as will be appreciated by one skilled in the art.

If a plurality of characteristics is used, each may be used singly or incombinations in search and retrieval processes. Multiple characteristicsearching may also incorporate different weightings assigned to eachcharacteristic: in one example GPS coordinate indicia may be given moreweight than street address indicia or name search characteristics in acombined geographic indicia selection and retrieval. Thus it is to beunderstood that the specific characteristics used are not critical, northeir specific combinations and weightings, and one skilled in the artmay select and weight one or more characteristics based upon what isneeded or preferred in a given application in furtherance of thepurposes of the inventions.

If no pictorial information is found or retrieved in response to thesearch, then at 306 the process is ended at 308. Else, if only one imageis returned by the search, then at 310 that image is associated with thechosen location at 312 and the process ended at 308. And in anotheraspect, if a plurality of image items is returned by the search, thenthe search results are analyzed with respect to at least onecharacteristic at 314, in order to further select or refine the imageselection for association.

Thus in one example, at 314 a primary standard or criteria is applied tothe search results. Thus where one or more items has been retrieved at304, rather than associate each and every item with the chosen location,one or more of the characteristic values used to select each item,and/or additional characteristic values associated with each item or thechosen location, may be utilized to select a preferred item or set ofitems for association with the location. In one aspect characteristicvalues of items may be compared to the other retrieved item valuesand/or to a primary threshold, and those items with best or bettervalues and/or equal to or greater than the primary threshold may beselected to populate a primary precision subset. In one example, one ormore pictorial information items having GPS coordinates closest to orwithin a threshold distance from chosen location GPS coordinates may beselected. In another example a primary precision may relate to imagequality, for example selecting one or more photographic items having thebest resolution or a resolution at or over a given threshold.

In another example photo perspective directions and/or view angles andselecting may be considered in order to retrieve and/or select one ormore items having perspectives and/or view angles best correlated withan expected view of a user as determined from the computed route, orwithin a threshold value from said expected view perspective. Time ofimage generation may be considered, for example selecting one or moremost recent photos or photos taken within a threshold elapsed time oftravel or route generation event, or selecting one or more most recentphotos at a similar time of day as the current time of day. One or moremost comprehensive photos may be selected based on one or more desiredfield-of-view criteria: for example, the scale or size of an imagefield-of-view may be evaluated and selected in response to ananticipated speed of a navigational system user, wherein imagesincluding entire areas or multiple structures or items may be selectedover more zoomed-in images for anticipated travel along a high-speedinterstate, and wherein zoomed-in images are instead preferred for lowspeed road travel through a business district road.

In another aspect, where a primary precision subset selected at 314comprises more than one item, or a number greater than some otherthreshold, then at 316 an additional level of precision may be appliedto a step 314 primary precision subset in order to further refine andreduce the items selected for association with the chosen location. Theadditional refinement process at 316 may apply one or more of the sameor similar criteria and characteristics, or one or more may differ. Thusin one example geographic criteria (such as GPS proximity) may beapplied to determine the primary precision subset at 314, and then aphoto resolution comparison process may be applied at 316 to select abest item or best group of pictorial information items. It will also beappreciated that other criteria for refining pictorial informationselections will be apparent to one skilled in the art, and the presentinvention is not limited to the examples provided herein, or to thisexemplary application. Moreover, if more than one characteristic is usedin any one process, or in multiple processes, then one or more of thecharacteristics may be weighted differently from others in making saiddetermination (thus for example, GPS coordinate information may beweighted greater than address criteria in selecting items throughgeographic criteria).

In another aspect, if none of the retrieved pictorial information meetsthe primary precision selection criteria at 314, then at 318 it may bedetermined whether any of the retrieved pictorial information is withina secondary level of precision, and thus relevant or proximate enough tothe chosen location in order to be associated with the chosen location.Thus in one example where each of the pictorial information itemsretrieved at 304 have GPS coordinates too far from chosen location GPScoordinates as determined in a primary precision determination at 314,then at 318 one or more items having GPS coordinates close to or withina second threshold distance from the chosen location GPS coordinates maybe selected to form a secondary subset. In one example the secondprecision subset items are then associated with the chosen locationalong with proximity information at 320 indicating a specific geographicrelationship to the chosen location, for example descriptor informationindicating distance and direction of the associated image or group ofimages from the actual current location. It will also be understood thatwhere a plurality of secondary level items are selected at 318, theitems selected may be further subject to an additional refinement orselection process, similar to the additional process at 316 describedabove with respect to the primary subject selection process at 314.

Pictorial information thus selected for association with the chosenlocations at 310, 314, 316, 318 and 320 is formatted for presentation toa system and process user at 312 in association with each chosenlocation. Relevant associated photographs may thus be transmitted tomobile devices as a user progresses through a chosen route to adestination, or in some applications a montage or loose collection ofgermane photographs may be pulled from central or distributedrepositories and presented as a navigational aid, for example in advanceof a trip. Thus in some embodiments if a plurality of items are selectedfor association with any one chosen location, then each of the items maybe presented or enabled for selection, such as through a plurality ofthumbnail images on one page or screen, or through screen scrolling orslideshow presentation techniques. A variety of presentation methods andsystems will be apparent to one skilled in the art, and the presentexamples are illustrative but not exhaustive of the present system andmethod.

In another aspect the association and presentation of pictorialinformation at 312 may comprise an image synthesis process, wherein aplurality of image items may be combined into a composite image or imageapplication. One exemplary photo synthesis process is Photosynth™ byMicrosoft Live Labs™, wherein a plurality of photos associated with ageographic location are analyzed for similarities and then combined toform a photographic three-dimensional reconstruction model of thelocation, one that may optionally be manipulated by computer processorinterface zooming and panning controls. Thus in one example of thepresent system and method a three-dimensional abstraction of a chosenlocation (or of a proximate location or area as determined at 318 and320) may be constructed from retrieved pictorial information, and alsooptionally incorporating other data. A photograph synthesis process mayalso enable the creation of a best-possible photograph or image from acollection of photographs and/or images that are otherwise deficientindividually in conveying desired information, thus additively combiningvisual information to create useful and relevant pictorial information.Or one or more items may be presented based upon user or system indiciainputs: thus if a user wants a close image, one or more zoomed-in imagesof an associated item set may be presented, or a synthesized construct“zoomed” in through some active Photosynth™ application. Moreover, itwill be understood that Photosynth™ is only one example of a photosynthesis application, and one skilled in the art will appreciate thatother photo synthesis applications and processes may be incorporatedinto the present invention, and that the present invention is notlimited to the embodiments described thus far.

Thus the present invention provides advantages in allowing for theselection and presentation of pictorial navigation aids to real-timenavigation devices, as well as static direction information, byexploiting positional information embedded in photos and other pictorialitems. The present invention thus enables users to see photos or imagesof where they are going, such as landmarks along the way and what thefinal destination looks like. This helps users become more familiar witha new route, better visualize where they need to make turns, and makeeducated choices in destination.

Thus through use of the present invention relevant photographs may betransmitted to mobile devices as a user progresses through a chosenroute to a destination, or a montage/loose collection of germanephotographs may be pulled from central or distributed repositories andpresented as a navigational aid in advance of the trip. Additionally,the invention may utilize known technologies such as photographsynthesis to create a best possible photograph from a collection ofphotographs, and accordingly, such synthesized photographs can thenprovide real-time navigational aids.

And as the associated photographs may be found, synthesized, and/orcompiled from one or more sources, optionally including user-designatedsources, the present invention enables extension of conventionalnavigation system route creation and presentation processes intoadditional and richer data sets and responsive creation options. Byenabling the use and search of user-driven sites, such as for exampleMyspace.com™, Tripadvisor.com™ or Flickr.com™, and/or one or moreavailable web-logs (blogs), a user may extend navigation route creationinto creating routes and information tailored to his individualpreferences and needs. Thus a user may search for results fromparticular site user profiles or known site users to return additionalspecialized recommendations, suggested waypoints, and/or images. In someexamples a recreational skateboarder may find and retrieve skate-parkproximate to chosen locations, as well as images correlated thereto, ora music fan may include a designated music website or blog in a searchfor image and/or location correlations. Still other applications will beapparent to one skilled in the art.

II. Computerized Implementation

Referring now to FIG. 4, an exemplary computerized implementationincludes a computer system 404 deployed within a network computerinfrastructure 408. This is intended to demonstrate, among other things,that the present invention could be implemented within a networkenvironment (e.g., the Internet, a wide area network (WAN), a local areanetwork (LAN), a virtual private network (VPN), etc.), or on astand-alone computer system. In the case of the former, communicationthroughout the network can occur via any combination of various types ofcommunication links. For example, the communication links can compriseaddressable connections that may utilize any combination of wired and/orwireless transmission methods.

Where communications occur via the Internet, connectivity could beprovided by conventional TCP/IP sockets-based protocol, and an Internetservice provider could be used to establish connectivity to theInternet. Still yet, computer infrastructure 408 is intended todemonstrate that some or all of the components of implementation couldbe deployed, managed, serviced, etc. by a service provider who offers toimplement, deploy, and/or perform the functions of the present inventionfor others. As shown, the computer system 404 includes a centralprocessing unit (CPU) 412, a memory 416, a bus 432, and input/output(I/O) interfaces 428. Further, the computer system 404 is shown incommunication with external I/O devices/resources 430 and storage system442. In general, the processing unit 412 executes computer program code,such as the code to implement various components of the methods andsystems described above for searching and retrieving pictorialinformation from databases 440 in communication with the computer system404, and for the formatting, associating and presentation thereof withrespect to chosen locations, which may be stored in memory 416 and/orthe storage system 442. It is to be appreciated that two or more,including all, of these components may be implemented as a singlecomponent.

While executing computer program code, the processing unit 412 can readand/or write data to/from the memory 416, the storage system 442, and/orthe I/O interfaces 428. The bus 432 provides a communication linkbetween each of the components in computer system 404. The externaldevices 430 can comprise any devices (e.g., keyboard, pointing device,display, etc.) that enable a user to interact with computer system 404and/or any devices (e.g., network card, modem, etc.) that enablecomputer system 404 to communicate with one or more other computingdevices.

The computer infrastructure 408 is only illustrative of various types ofcomputer infrastructures for implementing the invention. For example, inone embodiment, computer infrastructure 408 comprises two or morecomputing devices (e.g., a server cluster) that communicate over anetwork to perform the various process steps of the invention. Moreover,computer system 404 is only representative of various possible computersystems that can include numerous combinations of hardware.

To this extent, in other embodiments, computer system 404 can compriseany specific purpose-computing article of manufacture comprisinghardware and/or computer program code for performing specific functions,any computing article of manufacture that comprises a combination ofspecific purpose and general-purpose hardware/software, or the like. Ineach case, the program code and hardware can be created using standardprogramming and engineering techniques, respectively.

Moreover, the processing unit 412 may comprise a single processing unit,or be distributed across one or more processing units in one or morelocations, e.g., on a client and server. Similarly, the memory 416and/or the storage system 442 can comprise any combination of varioustypes of data storage and/or transmission media that reside at one ormore physical locations.

Further, I/O interfaces 428 can comprise any system for exchanginginformation with one or more of the external device 430. Still further,it is understood that one or more additional components (e.g., systemsoftware, math co-processing unit, etc.) not shown in FIG. 4 can beincluded in computer system 404. However, if computer system 404comprises a handheld device or the like, it is understood that one ormore of the external devices 430 (e.g., a display) and/or the storagesystem 442 could be contained within computer system 404, not externallyas shown.

The storage system 442 can be any type of system (e.g., a database)capable of providing storage for information under the presentinvention. To this extent, the storage system 442 could include one ormore storage devices, such as a magnetic disk drive or an optical diskdrive. In another embodiment, the storage system 442 includes datadistributed across, for example, a local area network (LAN), wide areanetwork (WAN) or a storage area network (SAN) (not shown). In addition,although not shown, additional components, such as cache memory,communication systems, system software, etc., may be incorporated intocomputer system 404.

Shown in the memory 416 of computer system 404 is a system of logiccomponents 401-409 configured to provide pictorial information relevantto a geographic location to a computer system application 402 configuredto produce navigation and routing services, more particularly to performthe functions illustrated in FIG. 1 and discussed above. An identifier401 is configured to identify a characteristic of a geographic location,as discussed above relative to element 101 of FIG. 1. A retriever 403 isconfigured to search a pictorial image database for images associatedwith an identified characteristic and retrieve at least one correlatedimage file visually depicting a physical appearance or an attribute ofthe location from the database, as discussed above relative to element103 of FIG. 1. An analyzer 405 is configured to analyze image filecharacteristics and responsively select preferred image data, asdiscussed above relative to element 105 of FIG. 1. A formatter 407 isconfigured to format the preferred image data for presentation to auser, as discussed above relative to element 107 of FIG. 1. And apresenter 409 is configured to associate the formatted image data withcorrelated locations and present the associated data to a user inassociation with the locations, as discussed above relative to element109 of FIG. 1. In another implementation two or more of the components401-409, including all of the components 401-409, can be a singlecomponent.

While shown and described herein as a method and a system, it isunderstood that the invention further provides various alternativeembodiments. For example, in one embodiment, the invention provides acomputer-readable/useable medium that includes computer program code toenable a computer infrastructure for providing pictorial informationrelevant to a geographic location. To this extent, thecomputer-readable/useable medium includes program code that implementseach of the various process steps of the invention.

It is understood that the terms computer-readable medium or computeruseable medium comprise one or more of any type of physical embodimentof the program code. In particular, the computer-readable/useable mediumcan comprise program code embodied on one or more portable storagearticles of manufacture (e.g., a compact disc, a magnetic disk, a tape,etc.), on one or more data storage portions of a computing device, suchas the memory 416 and/or the storage system 442 (e.g., a fixed disk, aread-only memory, a random access memory, a cache memory, etc.).

In another embodiment, the invention provides a business method thatperforms the process steps of the invention on a subscription,advertising, and/or fee basis. That is, a service provider could offerto provide pictorial information relevant to geographic locations. Inthis case, the service provider can create, maintain, support, etc., acomputer infrastructure, such as the computer infrastructure 408 thatperforms the process steps of the invention for one or more customers.In return, the service provider can receive payment from the customer(s)under a subscription and/or fee agreement and/or the service providercan receive payment from the sale of advertising content to one or morethird parties.

In still another embodiment, the invention provides acomputer-implemented method for providing pictorial information relevantto a geographic location. In this case, a computer infrastructure, suchas computer infrastructure 408, can be provided and one or more systemsfor performing the process steps of the invention can be obtained (e.g.,created, purchased, used, modified, etc.) and deployed to the computerinfrastructure. To this extent, the deployment of a system can compriseone or more of: (1) installing program code on a computing device, suchas computer system 404, from a computer-readable medium; (2) adding oneor more computing devices to the computer infrastructure; and (3)incorporating and/or modifying one or more existing systems of thecomputer infrastructure to enable the computer infrastructure to performthe process steps of the invention.

As used herein, it is understood that the terms “program code” and“computer program code” are synonymous and mean any expression, in anylanguage, code or notation, of a set of instructions intended to cause acomputing device having an information processing capability to performa particular function either directly or after either or both of thefollowing: (a) conversion to another language, code or notation; and/or(b) reproduction in a different material form. To this extent, programcode can be embodied as one or more of: an application/software program,component software/a library of functions, an operating system, a basicI/O system/driver for a particular computing and/or I/O device, and thelike.

The foregoing description of various aspects of the invention has beenpresented for purposes of illustration and description. It is notintended to be exhaustive or to limit the invention to the precise formdisclosed, and obviously, many modifications and variations arepossible. Such modifications and variations that may be apparent to aperson skilled in the art are intended to be included within the scopeof the invention as defined by the accompanying claims.

1. A method for providing pictorial information relevant to ageographical location, the method comprising: determining via aprocessing unit global positioning satellite coordinates of a geographiclocation of navigation route point of a route computed for a traveler;searching via the processing unit a pictorial image database for imageshaving an embedded tag associated with the determined global positioningsatellite coordinates, wherein searching the database comprisescomparing the determined geographic global positioning satellitecoordinates to global positioning satellite coordinate tags embedded inhe image files; in response to the searching, retrieving an image fromthe database having an embedded tag correlated to the determined globalpositioning satellite coordinates and visually depicting a physicalappearance of the location in a horizontal perspective and at a viewangle correlated with an expected view of the traveler from the computedroute and taken at a similar time of day as a current time of day;selecting via the processing unit a scale of field-of-view of the imagein response to an anticipation speed of the traveler on the computedroute; and presenting via the processing unit the image at the selectedscale of field-of-view to a user in association with the geographicallocation navigation route point.
 2. The method of claim 1 wherein theselecting the scale of field-of-view of the image in response to theanticipated speed of the traveler on the computed route comprisesselecting a low-speed scale of field-of-view for anticipated travelalong a low speed road that is more zoomed-in than a high-speed scale offield-of-view selected for anticipated travel along a high-speed road.3. The method of claim 2 further comprising: indicating a distance and adirection of the image from the geographic location.
 4. An article ofmanufacture comprising: a computer readable tangible storage mediumhaving executable program code embodied therewith the program codecomprising instructions which when executed on a computer system, causethe computer system to: determine global positioning satellitecoordinates of a geographical location of a navigation route point of aroute computed for a traveler; search a pictorial image database forimages having an embedded tag associated with the determined globalpositioning satellite coordinates, by comparing the determinedgeographic global positioning satellite coordinates to globalpositioning satellite coordinate tags embedded in the images files; inresponse to the search retrieve an image from the database having anembedded tag correlated to the determined global positioning satellitecoordinates and visually depicting a physical appearance of the locationin a horizontal perspective and at a view angle correlated with aexpected view of the traveler from the computed route and taken at asimilar time of day as a current time of day; select a scale offield-of-view of the image in response to an anticipated speed of thetraveler on the computed route; and present the image at the selectedscale of field-of-view to a user in association with the geographiclocation navigation route point.
 5. The article of manufacture of claim4, the program code instructions, when executed on the computer system,further causing the computer system to select the scale of field-of-viewof the image in response to the anticipated speed of the traveler on thecomputed route by selecting a low-speed scale of field-of-view foranticipated travel along a low speed road that is more zoomed-in than ahigh-speed scale of field-of-view selected for anticipated travel alonga high-speed road.
 6. The article of manufacture of claim 5, the programcode instructions, when executed on the computer system, further causingthe computer system to indicate a distance and a direction of the imagefrom the geographic location.
 7. A system comprising: an identifier thatdetermines global positioning satellite coordinates of a geographiclocation of a navigation route point of a route computed for a traveler;a retriever that searches a pictorial image database for images havingan embedded tag associated with the determined global positioningsatellite coordinates, by comparing the determined geographic globalpositioning satellite coordinates to global positioning satellitecoordinate tags embedded in the images files, and in response to thesearch retrieves an image from the database having an embedded tagcorrelated to the determined global positioning satellite coordinatesand visually depicting a physical appearance of the location in ahorizontal perspective and at a view angle correlated with an expectedview of the traveler from the computed route and taken at a similar timeof day as a current time of day; and a presenter that selects a scale offield-of-view of the image in response to an anticipated speed of thetraveler on the computed route and presents the image at the selectedscale of field-of-view to a user in association with the geographiclocation navigation route point.
 8. The system of claim 7 wherein thepresenter is further configured to select the scale of field-of-view ofthe image in response to the anticipated speed of the traveler on thecomputed route by selecting a low-speed scale of field-of-view foranticipated travel along a low speed road that is more zoomed-in than ahigh-speed scale of field-of-view selected for anticipated travel alonga high-speed road.
 9. The system of claim 8 wherein the presenter isconfigured to indicate a distance and a direction of the image from thegeographic location.